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SUMMARY 


The  purpose  of  this  paper  Is  to  formulate  a 
number  of  significant  mathematical  problems 
which  have  arisen  In  connection  with  the  theory 
of  scheduling,  and  to  disease  the  methods  which 
have  been  devised  to  treat  these  problems/ )  A 
brief  bibliography  Is  appended.  ^ 
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MATHEMATICAL  ASPECTS  OF  SCHEDULING  THEORY 

by 

Richard  Bellman 


Introduction 

The  purpose  of  thle  expository  paper  is  to  describe  a  number 
of  repreaentatlve  problem*  in  the  field  of  scheduling  which  will 
furnish  some  Idea  of  the  types  of  mathematical  questions  which 
confront  us  In  this  domain.  In  doing  so  we  shall  touch  upon  some 
of  tne  analytic  and  computational  techniques  which  have  been 
utllizeo  to  date  to  treat  these  problems,  and  thus  unavoidably 
display  the  deplorable  state  cf  the  art. 

There  Is  little  point  at  thi*  stage  of  development  of  the 
theory  In  attempting  to  give  any  precise  definition  of  what  we 
mean  by  a  "scheduling"  problem,  since  any  definition  which  can 
Include  the  spectrun  of  problems  arising  from  all  phases  of 
economic  and  Industrial  activity,  and  from  parts  of  mathematics 
Itself  ranging  from  algebra  and  topology  to  analysis  and  mathema¬ 
tical  physics,  will  necessarily  be  sufficiently  vague  to  be  fairly 
useleso.  We  can,  however,  make  the  following  general  remarks. 


In  characterizing  a  physical  system,  we  may  begin  with  a 
phenomenological  ppproach:  a  certain  cause  produces  a  certain 
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effect,  or,  alternatively,  a  certain  input  produces  a  oertain 
output,  Thus#  at  a  first  approach,  we  usa  tha  traditional  "black 
box"  concept i  tha  physical  system  is  regarded  as  inexplicable  in 
its  workings,  and  its  mechanism  is  taken  to  be  completely  sealed 
from  view.  We  agree  to  consider  only  the  "response  curves". 
Schematically 


Input  - 


>  Output 


As  we  besoms  more  ambitious,  we  begin  to  peer  into  the 
murky  confines  of  the  black  box,  and  our  next  step  is  to  divide 
tha  original  box  into  a  set  of  small  boxes  in  the  following  way 


Input 


Output 


Input  — 


Pinal 

Output 


We  now  have  a  multi-stage  process. 

A  further  degree  of  sophistication  yields  more  complex  block 


diagrams,  such  ar 
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Xnput^ 

\ 


Input 2 


Output ^ 


Output^ 


Output 

\ 

/ 

Output  x 


Final 

Output 


Eventually  we  may  be  forced  to  consider  even  more  complicated 
oirculta  involving  "feedbacks 


?  -►Outputs 


•  Output 


Final 

Output 


Classical  physics,  as  well  as  classical  economics,  is  con¬ 
cerned  with  the  general  problems  of  determining  the  output  of  a 
system  as  a  function  of  the  input,  and  of  determining  the  struoture 
of  the  syLtem.  This  is  an  inverse  problem  of  most  interesting 
type.  We  observe  some  Inputs  and  some  outputs  and  it  is  up  to  us 
to  wield  Occam's  razor  so  as  to  deduoe  the  structures  that  explain 
the  observations  In  the  most  esthetic  fashion. 


Simultaneously  with  general  problems  of  the  type  discussed 
above,  we  meet  the  problems  of  oontrol.  Starting  with  a  fixed 
structure,  we  wish  to  regulate  ;he  inputs  and  outputs  ao  as  to 
achieve  some  desired  state  of  the  system.  The**  problems  combine 


all  the  difflcultlea  of  the  problem  of  the  previous  stags  with 
the  additional  complications  presented  by  this  new  optimization 
problem.  On  the  other  hand,  we  may  note,  that  In  return  the 
optimal  system  will  possess  certain  simplifying  properties. 

Continuing  In  the  direction  of  controlling  the  system,  let 
us  suppose  that  we  have  the  pover  to  alter  the  basic  structure 
of  the  system  In  various  ways.  We  can  interchange  the  position 
of  various  boxes,  bypass  others,  Introduce  new  boxes,  and  so  on. 

The  problem  is  now  to  determine  the  structures  which  are  optimal 
accordinr  to  various  criteria  of  efficiency. 

Problems  of  the  last  two  types  we  call  "scheduling  problems". 
The  first  type,  difficult  as  it  is,  has  been  intensively  studied 
in  recent  years,  and  a  number  of  mathematical  techniques  has  been 
devised  to  treat  these  questions  with  some  degree  of  sucoesB. 

The  structural  problemc  involving  combinatorial  considerations 
have  only  recently  been  studied  in  an  intensive  manner.  They  in¬ 
volve  mathematical  difficulties  of  the  highest  order  even  in  what 

seem  to  be  the  simplest  oasts.  These  are  the  problems  me  shell 

focus  upon  In  ths  following  pages. 

We  have  spoken  above  of  input— output  curves,  tacitly  assuming 
b  deterministic  situation  where  the  output  is  a  fixed  function  of 
the  input.  In  many  situations,  a  convenient  mathematical  device 


fer  by— passing  lgnoranoe  is  to  assume  that  the  output  is  otochae- 
tlo .  In  sono  cases,  e . 3.  statistical  mechanics,  this  simplifies 
the  problenj  in  other  case* .  e.g.  assembly  line  production,  it 
greatly  complicates  It. 

Finally,  in  our  hierarchy  of  problems,  let  us  mention  one 
further  stage.  We  took  it  for  granted  in  posing  the  problem  of 
determining  optimal  arrangements  of  blocks  that  we  knew  the  re- 

1 

pponse  curves,  the  outputs  as  functions  of  inputs.  This  la  some¬ 
times  net  true.  In  some  situations  we  must  slmultaneou  jly  determine 
response  curves  and  optimal  structures.  Since  the  optimal  struc¬ 
ture  depends  upon  the  response  curves,  and  the  information  we  obtain 
concerning  the  response  curve  depends  upon  the  structure  we  assume, 
we  see  that  this  type  of  operation  la  quite  Involved. 

Processes  of  this  type  we  -all  "learning  processes".  They 
arise  in  connection  with  the  design  of  experiments  and  In  the 
theory  of  sequential  analysis. 


Since  It  Is  Impossible  In  a  survey  article  of  even  this  size 
to  give  any  adequate  coverage  of  all  or  even  of  some  of  the  most 
promising  aspects  of  this  fascinating  and  fundamental  field,  we 
have  compromised  by  discussing  a  very  few  topics  in  small  detail 
and  by  referring  briefly  to  a  multitude  of  others,  with  u 
bibliography  for  the  Interested  reader. 


Purther  references  to  these  Interesting  processes  may  be  feund  In 
R.  Bellman,  r,A  problem  In  the  Sequential  Design  of  Experiments", 

RAND  Corporation,  Paper,  P— S86 ,  1951*,  and  R.  Bellman,  T.  E. 

Harris,  and  H.  N.  Shapiro,  "studies  In  Functional  Equatl  ns 
Occurring  In  Decision  Processes",  RAND  Corporation  Paper,  P— 382,  1912. 


In  Part  I  we  shall  consider  a  number  cf  simple  prototype 
problems  associated  with  multi— stage  production  processes,  and 
various  mathematical  modelo  and  methods  which  have  been  used  to 
treat  these  problems.  In  passing,  we  ".hall  note  the*  connection 
between  these  problems  and  the  problems  of  organization  theory, 
problems  encountered  in  the  theory  of  switching,  and  the  con¬ 
struction  of  computing  machines,  insofar  as  these  are  all  problems 
of  determining  optimal  structure. 

Part  II  is  devoted  to  survey  of  some  of  the  work  that  has 
been  done  on  transportation  problems  In  connection  wlti.  deter¬ 
mining  most  efficient  routings.  The  Hitchcock-Koopmans  problem 
13  typical  of  the  questions  that  arise. 

Many  of  these  problems  can  be  treated  by  techniques  devel¬ 
oped  in  the  topological  theory  of  graphs  and  networks  due  to 
Konig,  Menger,  and  others,  which  in  turn  grew  out  of  the  work 
on  electrical  network  theory  by  Kirchoff. 

Iterative  techniques  for  solving  various  classes  of  these 
problems  have  been  given  by  M.  Plood  and  A.  Boldyreff.  In  par¬ 
ticular,  the  new  technique  of  Boldyreff,  the  "flooding"  technique, 
seems  to  have  great  possibilities  in  connection  with  many  similar 
types  of  problems.  Linear  programming  techniques  are  also 
applicable  in  many  cases. 
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The  third  part  Is  devoted  to  a  short  dlaoua»lon  of  'smoothing' 
problems  of  various  types*  Here  we  shall  meet  the  "caterer'  problem 
and  the  "optimal  Inventory"  problem  as  representative  problems  In 
that  area,  and  discuss  some  closely  associated  control  problems 
ooourrlng  In  engineering  control. 

In  Part  IV,  we  mention  briefly  some  scheduling  problems 
arising  In  computational  analysis.  Here  we  have  been  quite  ar¬ 
bitrary  In  our  choice,  and  any  expert  on  the  field  can  readily 

•41  a  aeere  m re  of  vital  questions. 

“  Part  V  is  devoted  to  a  brief  survey  of  some  applications 

of  the  theory  of  ^.lnear  programming  tc  the  field  of  scheduling  theory. 

Finally,  In  Part  V  we  do  some  crystal-gazing  and  discuss 
various  parts  of  mathematics  which  we  feel  w'  1  have  to  be  In¬ 
tensively  cultivated  before  essential  prog’  as  can  be  made  In 
the  field  of  scheduling  theory. 

We  have  omitted  any  detailed  dl-  -'.ssion  of  the  lower  level 
scheduling  processes,  such  as  those  which  occur  In  multi-stage 
productive  processes,  allocation  and  Investment  processes,  the 
calculus  of  variations,  the  theory  of  multi-stage  gar-es,  and 
generally  any  topics  which  can  be  treated  by  mathematical  tools 

t 

of  a  fairly  established  type.  In  a  sense  then,  we  are  being 
masochistic  and  deliberately  restricting  ourselves  to  those 
fields  where  we  must  plead  nul  contendere1'. 
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Part  I 

Assembly  Line  and  Related  Problems 
II .  Preliminaries 

In  this  part  of  the  paper  we  shall  consider  some  problems 
arising  from  the  study  of  multi-stage  production  processes. 

The  first  problem  we  shall  consider  involves  a  two-etage 
production  process  in  which  we  have  a  number  of  books  in  manu¬ 
script  form  which  must  be  printed  and  bound,  Je  wl3h  to  deter¬ 
mine  the  order  of  processing  the  books  which  minimizes  the  total 
tine  required  to  complete  all  the  books.  Two  solutions  will  be 
presented,  the  original  one  due  to  3.  Johnson,  based  upon  an 
explicit  formula  of  interest  in  itself,  and  a  solution  based 
upon  the  functional  equation  approach  of  the  theory  of  dynamic 
programming . 

Continuing  in  this  direction,  we  shrll  consider  the  analogous 
three-stage  process.  Formidable  difficulties  appear  in  this  case, 
and  there  is  at  the  present  no  solution  for  the  general  case.  This 
sad  statement  will  appear  repeatedly  In  the  lines  below. 

The  corresponding  explicit  formula  of  Johnson  for  the  three- 
stage  process  may  be  used  to  obtain  a  continuous  version  of  some 
par  'cular  caoeB  of  Importance.  In  the  continuous  case  we  can 
derive  a  very  simple  solution  which  throws  some  light  on  the  dis¬ 
crete  prublem. 
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Following  thla  we  shall  considsr  aome  natural  extensions  of 
the  simply-formulated  problama  mentioned  above.  These  problema 
are  cloaely  related  to  problema  In  organization  theory  of  the  type 
formulated  by  *J .  Marshak,  [7],  and  theae  In  turn  are  connected  to 
the  theory  of  switching,  to  the  theory  of  automata,  and  all  similar 
problems  Involving  the  construction  of  complicated  objects  from 
simpler  components,  [%] ,  . 

The  last  section  la  devoted  to  the  "assignment"  problem. 

Tills  la  a  simpler  problem  Involving  the  maximization  of  a  function 
of  permutations*,  and  may  be  treated  by  two  methods,  due  to  Hgervary 
ra.  and  von  Neumann  (!**].  Here  we  meet  the  fundamental  technique  of 
Imbedding  permutation  matrices  In  the  semi-group  of  doubly-stochastl 
matrices . 

12.  The  Book— binding  Problem 

Let  us  begin  by  considering  the  following  simple  problem. 

We  possess  one  printing  press,  one  binding  machine,  and  the  manu¬ 
scripts  of  a  number  of  possibly  different  books.  Assuming  tnat 
we  know  the  times  required  to  perform  tne  printing  and  binding 
operations  for  each  book,  we  wish  to  determine  the  <  rder  In  which 
the  books  should  be  processed  In  order  to  minimize  the  total  time 
required  t<  turn  out  all  the  books. 

This  Is  a  problem  In  rearrangemente ,  or  permutations,  which 
In  any  particular  case  can  conceivably  be  determined  by  a  Urect 

•  In  the  sense  that  It  has  been  effectively  solved,  while  the 
others  have  not  been  so  far. 
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enumeratlon  uf  pesslbl  11  ties .  Lest  anyone  too  blithely  refer  to 
modern  computing  macnlnts,  let  ub  quote  some  figures. 

The  number  of  possible  arrangements  or  ten  different  Items 
1  s 

(1 )  10!  -  3,62o,dOO  , 

while  the  number  cf  pc_  1  ..  rran^ements  cl  twenty  different 
Items  1b 

(2)  20!  -  2,432,902,008,175,640,000  . 

To  give  some  Idea  of  the  magnitude  of  this  number,  let  us 
merely  obeerve  that  at  one  sorting  per  microsecond  an  enumeration 
of  the  201  possibilities  would  require  well  over  a  half  a  million 
years.  Clearly  we  must  use  some  native  "lnwlt” . 

§  3 •  Lemmas  of  6  .  Johnson 

Let  us  Introduce  seme  notation.  Let 

th 

(1)  H1  ”  required  to  print  tne  1 —  book, 

b^  ^  time  required  to  bind  the  1—  book, 

for  1  -  1,  2,  ...,  n,  where  n  Is  the  number  of  different  books. 

We  wish  to  determine  the  'rrangements  of  the  books  which 
yi  eld  the  minimum  time  required  to  print  and  bind  all  the  books. 
It  Is  assumed  that  the  printing  will  precede  the  binding  in  each 

bC  OK  . 

The  first  result  we  snoil  require  Is 
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Lemma  1.  To  obtain  a  minimal  ordering,  it  is  aufflclcnt  to  con  - 
alder  that  the  bool: a  are  processed  In  the  same  ordor  througn  Loth 
machines. 

A  possibility  which  cannot  be  discounted  without  lnveat igation 
la  that  It  may  De  more  efficient  to  feed  the  books  Into  the  binding 
machine  In  some  order  different  °rora  that  used  on  the  printing  press. 
A 8  we  shall  see  below,  this  result  concerning  Identical  ordering 
carries  over  to  the  three-stage  process,  but  not  to  four-stage 
processes . 

Let  us  begin  by  taking  the  items  In  chronological  order,  l.e. 

a.  y_ 

the  1—  Item  in  the  1— -  position,  and  derive  an  expression  for 
the  total  time  required  to  complete  the  process. 

Define 

(2)  -  Inactive  time  on  the  second  machine,  the  binding 

machine,  immediately  before  processing  the  1— 

Item. 


In  many  cases,  of  course,  will  be  zero, 
on  the  second  machine  Is  the  sum 

n 


(3) 


n 


7. 

1  =  3 


x 


1 


The  total 


Idle  tlm  : 


n 

and  thus  the  total  time  required  for  the  process  is  I  ■  h. 

il  ,  ^  ^  J. 

It  follows  that  we  may  take  I  as  our  measure  of  the  efficiency 
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of  a  acheduling  of  operations,  and  that  it  is  this  quantity  which 
we  wish  to  minimize. 

Schematically, 


An  Important  result  for  our  purposes  la 
Lemma  2. 

n  u  u— 1 

(4)  I  -  Z  x.  -  max  (2  a.  -  £  b* ) 

n  1-1  1  l^u^n  i-i  1  1-1  1 

Proof;  We  have 

(5)  xx  -  ax 

x2  -  max (a ^  ♦  a2  -  b1  -  x1#  0) 

whence 

(6)  X}  +  *2  -  max(a1  +  a2  -  b1#  a1) 


Similarly 


_ '  1  _ 

3  2  2 

(7)  x-,  -  max( X  a.  -  Z  b.  -  Z  x. ,  0) 

J  1-1  1  1-1  1  1-1  1 

3  3  2  2 

I  x.  -  max(Z  a.  -  Z  b. ,  Z  x. ) 

1-1  1  1-1  1  1-1  1  1-1  1 

3  2  2 

-  max(Z  a.  -  Z  b.,  Z  a.  -  b, ,  0) 

1-1  1  1-1  1  l-l  1  1 

It  la  clear  now  how  the  proof  proceeds  by  Induction  for  n  >  3. 

M,  The  Result  of  3 .  Johnson 

The  problem  of  determining  the  optimal  order  is  equivalent 
to  determining  the  arrangement  of  the  n  ltema  which  minimizes  the 
expression  for  I  given  In  (3*1*).  We  thus  have  a  numerical  func¬ 
tion  defined  over  the  permutat5on  group  of  order  n,  and  we  wish 
to  determine  the  minimum  of  this  faction. 

The  solution  Is  given  by 

Theorem  1.  The  optimal  ordering  Is  determined  by  the  following 
rule:  Item  1  precedes  item  J  If 

(1)  mln(a1#  b^)  <  min(aj,  b±) 

If  there  Is  equality,  either  ordering  Is  optimal,  provided  that 
It  Is  consistent  with  the  definite  preferences . 

For  Johnson’s  derivation  of  his  result  and  the  remainder  of 
the  proof  that  this  criterion  yields  the  absolute  minimum,  we  refer 
to  his  paper,  [5].  We  ihall  give  another  derivation  below. 
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The  Importance  of  this  result  reeldee  In  the  fact  that  It 
shows  that  In  this  problem  the  minimum  time  may  be  fcund  by 
determining  the  effect  of  the  Interchange  of  any  two  neighboring 
items.  This  result  Is  not  true  in  general  and  accounts  for  the 
difficulty  of  the  multi-stage  problem  for  more  than  two  stages. 

§5*  An  Example 

Let  us  now  illustrate  the  simple  way  in  which  this  criterion 
may  be  applied.  We  follow  the  steps  given  below: 


?.  Determine  the  mlnlimm  of  all  the  and  b^. 

3.  If  it  la  an  u^,  place  the  corresponding  item  first. 

4.  If  it  is  a  b^,  place  the  corresponding  item  last. 

5.  Cross  off  both  times  for  that  item. 

6.  Repeat  the  steps  on  the  reduced  set  of  ( n — 1 )  items. 
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7.  In  case  of  ties,  order  the  items  with  smallest  subscript 
first,  for  the  sake  of  definiteness.  If  a  tie  between  a1 
and  b^,  order  the  item  according  to  the  a-rule. 


To  illustrate  the  method,  consider  the  following  example 


1 

ai 

1 

4 

5 

2 

4 

1 

3 

^0 

4 

4 

6 

30 

5 

2 

3 

The  rule  yields  (5,  1#  4,  3#  2)  as  the  minimal  order  with  a 
total  time  of  47  units,  and  4  units  of  idle  time.  For  the  reversed 
order,  the  total  time  is  78,  the  longest  time. 

§6.  An  Alternate  Derivation  of  the  Decision  Function 

Let  us  now  give  another  derivation  of  the  decision  function 

given  above  in  (4.1)  using  the  functional  equation  approach  of  the 

theory  of  dynamic  programming,  [l] .  It  has  the  merit  of  yielding 

this  function  without  the  use  of  the  explicit  formula,  given  in 
V}.4)  above. 

Let  us  define 

(l)  f  (a1,b1,a2,b2, . . .  »aw#t>N,  t)  -  the  time  consumed  it,  processing 

the  n  1  terns,  when  the  second 
machine  is  conmitted  t  hours 
ahead,  and  an  optimal  policy  is 
emplo; ed . 


If  the  first  Item  Is  processed  first,  we  have 


(2)  ^2*  ‘ 1  p  ^ ^  1 

&2  +■  f  Q  0 ,  0 ,  a  2 ,  ^ 2 *  *  *  ’  *  ®)j *riax ( t — ft ^  >0)  J  • 
Choosing  the  second  Item  to  follow,  v.’c  obtain 

(3)  f ( # ^1 * ® 2 * ^2 *  * ' *  * 1 #  ^  m 

a  ^  >a2  0#0»0»0»h^»h-j,  .  •  • ,  a^,  b^ ,  g  ( ft  ^ ,  b  1 ,  a  2 ,  b  ,  t) 


where 


(^)  R(ft| ,b^ jftpjbp,  t)  ■ 

b2+max  Q  bj-a^maxf t-a^  ,0) ,  0  ] 

On  the  other  hand,  interchanging  the  orders,  we  obtain 


(5)  f(a1,b1,a2,o2, .. .,aN,bN,  t) 

n2  *Ql'*’lP  *  *  •  *  ^  ,  g  ( a  2 ,  b  2 ,  a  ^ ,  b  ^ ^  ZJ 

It  follows  from  this  that  the  order  of  operations  which  minimizes 
the  new  t— term  is  optimal.  Hence  we  choose  the  order  which  yields 
the  minimum  of  g(a1#  b,,  a0,  b2,  t)  and  g(a2,b2,  a^,  b^,  t).  It 
Is  not  immediately  obvious  ttat  this  choice  will  be  Independent 
of  t,  and  It  is  actually  quite  surprising  that  this  is  so.  We  have 

(6)  c(a1,b1,a2,b2,t)  =  b2  max  £  b^-ftg+maxf  t-^ ,0) ,  0^ 

-  b1+b2-a2-t-maj>c  Qmax(t— a^O) ,  a2— b^  ^ 

■  4b2-a2*max  Q  t  -  a^,  0,  a2  -  b^  J 

-  b^4b2— a^-a^maxQ  t,  a^,  b2Z] 
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It  follows  from  this  that  regardless  of  the  value  of  t,  the 
ordar  of  operations  which  yields  the  minimum  of  max  Q  a^  ,a^  ^a^-b^  ] 
and  max  C  a2'al4’,l2”'*>l  3  cannot  increase  the  total  time,  end  may 

decrease  it. 

::t  is  easily  seen  that  this  criterion  is  equivalent  to 
Johnson's  criterion  above. 

§7 .  The  TTiree-etage  Process 

Let  us  now  consider  the  three  stage  process  obtained  from  the 
previous  two  stage  process  by  the  addition  of  a  third  required 
operation,  which  we  can  think  of  as  the  typing  of  the  manuscript. 
We  now  have  n  books  in  manuscript  form  which  require  successively 
typing,  printing  and  binding.  Let  a^,  b^,  c ^  represent  the 

4.  y. 

respective  times  required  by  the  i—  book  for  each  of  these 

processes. 

The  first  result  we  require  is 

Lemma  3*  To  obtain  a  minimal  ordering .  It  1b  sufficient  to  con¬ 
sider  the  case  where  the  booke  are  processed  in  the  Baine  order  on 
the  th~ee  machines. 

A  double  Application  of  Lemma  1  yields  this  result. 

The  example 


1 

*i 

bi 

ci 

di 

1 

3 

3 

3 

2 

3 

1 

1 

3 

of  two  Items  going  through  a  four-stage  process  shows  that  uniform 
ordering  Is  not  universally  valid.  It  is  easy  to  verify  that  In 
this  case  the  optimal  arrangement  changes  in  going  from  the  second 
to  the  third  stages.  However,  the  ordering  on  the  first  two 
machines  and  the  ^ast  two  machines  may  always  be  taken  to  be  the 
s.'une  regardless  of  the  rnsnber  of  stages. 

Let  us  now  present  a  formula  for  the  total  Idle  time  on  the 
third  machine  similar  to  that  given  above  for  the  two-stage  pro¬ 
cess.  Let 

(1)  y  «  the  Idle  time  on  the  third  machine  Immediately 

preceding  the  processing  of  the  1^  item. 


Schematically 


► 


+ 


The  same  type  of  argumentation  as  above  y'  -Ids  the  formula 


Lemma  4 . 
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(2) 

n 

Z 

l“i 

yi  “ 

max  <HV  *  K.  ) 

l^u^v^n 

where 

(3) 

Hv 

v 

t-t  ^ 

1-1 

u— 1 

b .  —  Z  c  4  , 

1  1-1  * 

v  ■  1 1  2 1  • «  •  i  4. 

u 

-  Z 

1-1 

u — 1 

a.  —  Z  b.  , 

1-1 

u  -  1,  2#  . . . ,  n 

As  yet,  no  one  has  been  able  to  uae  this  formula  to  derive 
the  optimal  ordering  for  the  three  stage  problem.  As  we  shall 
•ee  from  the  discussion  of  the  continuous  version  below,  ♦  e 
general  solution  must  have  a  quite  complicated  form. 

§8.  A  Continuous  Approximation 

In  view  of  the  lac'c  of  success  In  treating  the  general 
problem.  It  seems  worthwhile  to  consider  irlous  special  cases 
In  the  hopes  that  the  aolution  of  these  may  throw  light  upon  the 
general  case. 

Let  us  consider  first,  to  Illustrate  the  method  we  shall 
employ,  the  particular  case  where  we  have  two  stages  and  only 
two  types  of  Items,  each  occurring  In  large  quantities.  As  an 
approximation  to  the  expression 

u  u-1 

(1)  S(u)  -  2  a  -  2  b 

1-1  1-1 


we  shell  consider  the  Integral 
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(2)  I(u)  -  yiu  (a(t)  -  b(t))dt 

Aa  an  analogue  of  the  arrangement  of  theoe  n  Items  of  only  two 
distinct  types,  we  shall  consider  a  characteristic  function,  +(t), 
defined  over  the  Interval  [0,T],  which  la  to  say  a  function  4(t) 
with  the  property  that 

(3)  ♦(t)  -  1  for  tcS,  a  subset  of  [0,T] 

-  0  for  t  In  the  corap  lament  of  3. 

Since  there  are  only  two  types  of  Items,  a ( t )  and  b(t)  are 
determined  by  the  relations 

(4)  a(t)  -  +  a2(l-4) 

b^  t)  -  bx4  +  b2(M) 

We  now  wish  to  determine  4(t)  so  as  to  minimize  the  funo- 
tional 

(5)  I(T)  -  nax  [  /1U  (a(t)  -b(t))dt] 

O^T  ^  ° 

subject  to  the  conditions 

(6)  a.  <fr(t)  -  0  or  1  , 

b.  jTj  4(t)dt  -  k  <  T  . 

The  last  condition  Is  the  continuous  analogue  of  the  con¬ 


dition  that  k  of  the  Items  are  of  the  first  type  and  n  -  k  of  the 
second  type. 


P--Oljl 

_'  ) '  _ 

Uelng  (4),  the  problem  xs  that  of  dete-mlnlng 

(7)  min  max  Qa  /*J  ^dt  +  Pu  1 

4  0<P<T 

whore 

(8)  a,  a  -  (ax  -  a2)  +  (b2  -  b:) 

b.  £  -  (a2  -  b2) 

It  Is  easy  to  see  that  a  solution  is  given  by 

(9)  a  >  0:  *(t)  -  0  ,  O^t^T-k 

*(t)  -1  ,  T  —  k  <  t  <;  T  . 

a  <  0:  *(t)  -  1  .  0  ^  t  ^  k 

*(t)  -0  ,  k  <  t  £  T  . 

We  see  that  the  form  of  the  solution  depends  upon  only  the 
ordering  of  the  quantities  a,  -  b1  and  a2  -  b2#  which  is  precisely 
what  we  might  expect.  A  similar  solution  Is  obtained  for  any 
number  of  distinct  types  of  Items,  see  [?]  . 

§9  Continuous  Version-three  Machines 

Let  us  now  discuss  the  continuous  version  of  the  three-mac  line 
or  three  stage-process,  again  for  the  case  of  two  types  of  Items. 

As  the  continuous  analogue  of  the  Idle  time  on  the  third  machine 
we  have  the  functional 


P-/  53 

(1)  T(?)  -  max  £  /?u  (a(t)-b(t)  )dt  4  /*v  (b(t)-c(t))dt  ] 

O^v^T  ^ 0 

-  max  [  a  /*u  +dt  ♦  +  t  /" v  ^dt  ♦  6v  1  , 

0^v^T  ^ 0  'S 0 

whore 

(2)  a(t)  -  a14  ♦  a2(l-^),  b(t)  -  b^  +  b^(  1— ♦)  , 

c(t)  -  -*  c2(l-^)  , 

and 

(3)  a  -  *l  -  a2  v  b2  -  bx 
0  -  a2  -  b2 

¥  m  “  ^2  +  c2  ^1 

6  ■  bp  Cp  • 

We  -vlah  to  determine  the  minimum  of  1^  for  all  4  subject  to 
the  conditions 

(4)  a.  4( t )  *■  0  or  1  , 

b-  Jo  *dt  -  k  • 

Aa  we  shall  see  below  the  minimum  over  this  class  of  functions 
may  not  exlat.  Let  u*  then  consider  the  more  extensive  class  of 
functions  sa^lsfyinp  (4b)  and  the  weaker  condition 

(5)  0  ^  <Kt)  s,  l  . 


The  aolutlon  to  this  problem  is  contained  in 
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Theorem  4.  The  minimum  value  of  I  la 

(6)  V(k,T)  -  max  [0,  »k  ♦  &T,  (a+g)k  +  (fl+6)T  "]  . 

A  minimizing  4  i£  given  by 

(7)  4#(t)  -  k  A  £or  O^t^T  . 

In  general,  the  aolutlon  is  non— unique . 

The  proof,  which  la  quite  simple,  may  be  found  In  [p] . 

The  particular  solution  given  above,  4*#  Involve#  mixing 
which  In  the  discrete  case  is  impossible,  although  we  can  always 
approximate  to  it.  Since  the  solution  in  non— unique  in  general, 
it  Is  possible  that  in  many  cases  the  solution  will  have  the 
simpler  form 

(8)  +(t)  -  1  ,  0  £  t  <,  k  , 

-  0  ,  k  <  t  ^  T  , 

whloh  corresponds  to  a  very  simple  solution  in  the  general  case. 

As  we  shall  aee  below  we  can  find  values  of  the  parameters 
for  which  the  solution  cannot  have  this  simple  form,  and,  as  a 

matter  of  fact,  for  whloh  the  solution  qiven  above  is  the  ’unique 

soli  .Ion. 

The  importance  of  this  result  Is  that  it  ehows  that  the  three 
stage  process  presents  a  genuinely  difficult  problem. 


§10.  Example  of  Unique  Solution  • 

Let  uo  take  k/T  -•*  1/2,  bo  that  we  may  take  k  »  1/2  and  T  -  1. 
Choose 

( 1)  a,  -  2  ,  b1  -  3  *  Cj  -  1  , 

^  2  ,  -  1  ,  ci  "  3 

Then 

(2)  a  -  -2  ,  {3-1,  &  *=  4  ,  6  -  2  . 

Hence 

(?)  V  =  max  (0,  5k  *  ST,  (afj)k  ♦  (p+6)T) 

«  max  (0,  0,  0)  «-■  0 

Thus,  If  b(t)  la  a  minimizing  function  we  must  have 

(4)  max  [a  /'u  ^dt  +  0u  +  V  Pw  ^dt  +  6v  j  -  0 

°^VST  ^ 

which  for  the  set  of  parameters  chosen  above  reads 

(5)  max  2  P u  ^dt  4  u  +  4  Pw  ^dt  -  2v  ~]  -  0 

o<umi  v/0 

For  all  u  and  v  in  the  range  0  u  v  1  we  must  )iave 

(6)  -2  ♦dt  4-  u  4-  4  ^dt  -  2v  -  0 

Setting  v  -»  u  the  result  la 

(7)  2  JT  41 1  i  U  , 

for  0  /  u  ^  1. 


Due  t(  Oliver  Grc  so 


p-^Jbl 


On  the  other  hand,  setting  v  -  T  »  1,  and  using  the  relation 

(6)  y;1  #<it  •  k  - 1/2  , 

we  obtain  from  (b)  the  condition 

(9)  ~2  So  *dt  *  u  i  0  • 

Comparing  ( f)  and  (9),  we  see  that  we  must  have  equality 

(10)  Jlu  *dt  =  u/2 

Prom  thla  we  see  that  ^(t)  =  1/2  for  almost  all  u,  which  lo  to 
oay  the  aolutlc*.  la  unique  In  the  set  of  Lebeague  lntegrable 
functions  satisfying  the  constraints. 

511.  Stochaatlc  Vers  Iona 

Let  ub  now  consider  the  case  In  which  the  processing  tlme3 
are  stochaatlc  rather  than  fixed  parameters.  In  other  words,  each 
Item  has  associated  with  it  a  set  of  distributions  for  the  times 
required  on  the  various  machines. 

The  problem  Is  now  that  of  determining  arrangements  which 
minimize  the  expected  value  of  the  total  time  required  to  process 
all  the  books,  or  some  other  mean  of  the  total  time,  Whatever  the 
difficulty  of  the  deterministic  versions  we  have  discussed  above, 
the  stochastic  version  seems  to  transcend  them.  Nothing  la  known 
about  the  solution  even  in  the  two  stage  pro 'ess. 

Since  the  total  time  will  be  a  nonlinear  function  of  the 
Individual  processing  times,  it  is  clear  that  a  knowledge  of 
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•;xpec:ed  valu.'fj  of  indlvtdnl  pro cor.nl mg  times  wl  11  not  be  sufficient 
to  determine  the  minimum  total  expected  time. 

This  problem  introduces  some  Interesting  queetlone  concerning 
the  "stability"  or  ’  stiffness'  of  a  scheduling  policy.  An  ordering 
which  minimizes  the  expected  total  time  may  very  well  permit  of  a 
large  variance.  Consequently,  for  many  purpeses  a  "looser'’  solu¬ 
tion  with  more  flexibility  and  alack,  which  la  comparatively  un¬ 
affected  by  minor  variations,  may  be  more  desirable. 

A 1  though  these  Ideas  ere,  of  course,  well-known  In  practice, 
a  precise  mathematica1  formulation  aeeme  difficult. 

t 1 2 .  Queuing  Theory 

If  wc  fix  the  order  and  fasten  our  attention  ”pon  the  dis¬ 
tribution  of  Idle  times,  the  distribution  of  waiting  times,  and 
similar  questions,  we  enter  the  domain  of  queuing  theory,  see 

[6]- 


In  this  connection,  wo  would  like  to  point  out  that  the 
explicit  formulas  of  Johnson  .may  be  of  some  utility  in  determining 
limiting  distributions. 

Il  j .  Intensions 

Although  it  may  seem  quite  academic  to  discuss  extensions 
wren  tho  3'mplest  problems  defy  analysis  at  the  moment,  it  is 
actually  worthwhile  to  scan  the  horizon  If  only  for  the  sake  of 
Inspiration. 


F  '>‘.1 
'J7- 

Tn  rerilirtlc  problems  we  will  be  dealing  w’  t\  proce  isoa  in 
which  there  are  many  machines  ol  each  type  at  each  stage.  A  ftr3t 
question  thaw  arises  la  that  of  our  policy  of  feeding  items  into 
the  machines  at  any  particular  stage.  Per  example,  we  may  retain 
a  rigid  order,  so  that  in  the  caae  of  three  machines,  the  first, 
fourth  and  seventh  items,  and  so  forth,  go  to  the  first  machine, 
the  second,  fifth  and  eighth  go  to  the  second  machine  and  so  on. 

Or  we  may  use  a  first-come  first-serve  principle  and  a1  locate 
each  new  item  to  the  machine  which  Is  free,  or  committed  for  the 
least  time  ahead. 

The  determination  of  a  feeding  policy  is  part,  of  course,  of 
the  general  scheduling  problem,  but  it  will  be  simpler  to  solve 
scheduling  problems  of  this  type  if,  arbl trarl ly,  we  restrict  car- 
selves  to  certain  types  of  sub-policies. 

If  many  of  the  processes  are  interchangeable,  although  not 
all,  w«  have  the  Important  problem  of  determining  the  arrangement 
of  the  stages. 

W*'  may  also  consider  ourselves  to  have  available  a  semi¬ 
fluid  1  abor  force  which  can  be  assigned  in  various  comb lnat ions 
to  man  the  machines  at  various  stages,  there’ y  decreasing  the 
processing  time  at  that  stage.  The  question  is  now  that  of 
detcnninJ ng  the  optimal  partitioning  of  the  labor  force  among 
the  various  activities. 

Further,  more  detailed  discussions  will  be  f^und  in  Salveson, 
[9]  »  I*0].  and  Vasunyl,  l_l  1  j  ,  • 


Plnellv  there  Is  the  overall  problem  of  allocating  money 
for  the  purchase  of  various  types  of  machines  and  various  categories 
of  labor.  It  la  oasy  to  see  tnat  we  can  construct  hierarchies  of 
problems  of  increasing  orders  of  difficulty.  We  can,  however,  ob¬ 
tain  approximate  solutions  to  the  larger  problems  by  simplifying 
the  behavior  of  the  component  parts,  with  the  result  that  from  a 
certain  stage  on,  the  solution  of  the  overall  problems  rrjiy  be 
simpler.  If  leas  exact.  This  lo,  after  all,  the  usual  technique 
employed  In  the  treatment  of  the  physical  world. 

$  1 4  .  Organization  Theory 

It  Is  clear  that  In  considering  the  general  problem  of 
arranging  combinations  of  men  and  machines  to  perform  certain 
multi- component  tasks,  we  are  encroaching  upon  tho  domain  of 
organization  theory. 

The  mathematical  problems  encountered  here  are  of  precisely 

the  same  general  nature  as  those  discussed  above,  and  abstrac  tiy, 

there  is  no  difference.  For  those  interested  in  some  of  the 

questions  In  this  field  which  have  been  treateu  recently,  we 

refer  o  the  work  of  J.  Marsch&k,  [7],  [8],  on  the  theory  of 
team©  and  similar  problems. 

A  particularly  Interesting  set  of  problems  arise  in  connec¬ 
tion  with  the  design  of  automatic  control  circuits,  computing 
machines  and  related  mechanisms.  The  mathematical  techniques 
employed  here  range  over  Boolean  algebra,  ruuthematlcal  logic. 
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topology  and  other  regions  of  abstract  mathematics  which,  at  first 
glance,  would  seem  far  removed  from  applications .  Por  a  discussion 
of  the  "switching"  problem,  see  Hohn  [4] ;  for  a  discussion  of  the 
automaton  problem,  see  /on  Neumarn,  ft  . 


§15.  The  Assignment  Problem 

In  the  seotlons  above  we  have  attempted  to  determine  the 
minimum  over  all  permutations  of  n  objects  of  a  certain  function 
associated  with  these  permutations.  As  we  know,  the  group  of  nl 
permutations  on  n  objects  is  equivalent  to  tho  group  of  permutation 
matrices,  P,  of  the  representative  fora. 


characterized  by  the  property  that  there  Is  precisely  one  non-zero 
element  in  each  row  and  column. 

Consequently,  In  place  of  maximizing  over  all  permutations, 
we  can  think  of  maximizing  a  function  f(P)  over  all  matrices  P. 

The  simplest  such  function  la  a  linear  function 


(2) 


f(F)  -  tr  (AP)  , 
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n 

wneie  tr  (d)  -  L  b  ,  the  sum  cf  the  diagonal  elements  o f  a 

1-1  -1 

matrix  B. 

This  function  actually  occurn  In  connection  with  an  Important 
problem,  the  "asslgnmen"  protlem",  which  reads  as  follows:* 

"Given  n  men  and  n  Jobe  with  the  utility  of  the  assignment  of 
tne  l—  man  to  the  Job  equai  to  r  ,  ifj  •  1*  2,  n,  deter¬ 

mine  tne  allocation  of  assignments  which  maximizes  the  total 
utility . ” 

Crudely  we  see  that  we  have  n!  posoibl litlee  to  contemplate. 
There  aie  two  ways  cf  overcoming  this  difficulty.  The  first  1b 
due  to  von  Neumann,  ft'*]  ,  who  converts  the  problem  Into  an  n‘  x  ?n 
game  which  la  a  generalized  version  of  "hide— and-seek” .  The 
second  Is  due  to  z.gervary,  |3j  »  and  Is  based  upon  some  work  of 
D.  Konlg  In  the  theory  of  graphs. 

Tne  bas3 c  principle  Involved  In  each  Is  the  fact  that  we  can 
Imbed  the  permutation  matrloee  In  the  continuous  set  of  doubly— 
stochastic  matrices  of  order  n,  l.e.  matrices  P  »  jp^)  charac¬ 
terized  by  the  properties 

(j;  a.  0  <  ptJ  <  1  , 


n 


n 


C  •  P,  «  *  i  » 

1  -1  1  J 

•  Some  very  Interesting  generalizations  of  these  problems,  dealing 
with  teams,  have  been  formulated  by  L.  Shapley  ,  (unpublished). 
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and  that  the  permutation  matrices  ar«  the  extreme  elements  of  this 
convex  set,  a  result  due  to  G.  Blrkhol’f.  Another  proof  is  con¬ 
tained  in  von  Neurn^  ,n ,  . 

Other  problems  involving  maxlmlzatl  )n  over  the  set  of  permu¬ 
tation  matrices  arise  1 n  various  parts  of  transportation  tneory. 
he  mention  tne  "travelling  salesman"  problem,  and  a  problem  of 
Beckaann  and  Koopmans  which  requires  the  maximization  of  tr  (I’APD). 
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Part  II. 

Ti  ansportnt ion  Problems 


t 1 .  Introduction 

A  large  and  Important  class  of  problems  with  strong  topo¬ 
logical  overtones  arise  from  the  determination  of  efficient  trans¬ 
portation  schedules  for  buses,  trains,  airplanes,  cargo  shlp3,  and 
so  on. 

Since  the  subject  Is  a  vast  one,  with  most  of  what  Is  known 
to  date  In  readily  available  papers,  we  shall  content  ourselves 
with  a  brief  reference  to  the  work  on  the  HI tchcook— Koopmans 
transportation  problem,  which  Is  representative  of  the  type  of 
question  that  arises,  and  then  discuss  the  question  of  determining 
the  capacity  of  a  rail  network.  Tnis  problem  is  particularly 
Interesting  since  It  may  be  approached  by  means  of  the  theory  of 
graphs,  using  the  results  of  Menger,  or  by  means  of  linear  pro¬ 
gramming,  or  by  moans  of  various  iterative  techniques  such  as 
the  "flooding"  technique  of  3oldyreff. 

§2.  The  Hltchcopg-Koopmana  Transportation  Problem 

Suppose  thet  we  have  M  ports  containing  cargoes  and  N  ports 
as  destinations  t  1*  these  cargoes. 


i  ^  “  1 
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t.  *  i 

Let  d^  be  ti'.e  '  an  between  the  1—  cargo  pert  and  J 
tlun,  and  let  x. ,  be  the  car#  transmitted  between  these 

i 

The  c  >8t  of  tranomlttlnK  thla  cargo  In  taken  to  be  x,  ,d, 
that  we  nave  an  amount,  c4t  of  corg  at  the  1—  \  vl  and 
ment  r,  at  tne  J—  port,  with 


t_n 

tw 

J* 

a 


deal 1 na- 
I ort a  . 
Assume 
r*  qul  re- 


(1)  L  c .  «  21  r,  , 

1  J  J 

and  that  It  Is  desired  to  transmit  all  the  carg/.  at  h  min'  mam 
total  Cl  et . 


The  mathematical  problem  is  that  of  minimising  the  linear 

form 

M ,  N 

(2)  L  d11xi. 

4  I  _  \  J  J  A  v 
1  »  J  1 

subject  to  the  constraints 

M 


a  . 

* 

•w 

1  “1 

XU 

N 

b. 

I 

XU 

J-l 

c . 

X1J 

A  thortugh  discussion  of  an  Iterative  technique  for  solvin'" 
this  problem  1b  given  by  Flood,  [3],  and  a  discussion  of  related 
classes  of  problems  if  contained  In  Koopmanc,  [7j ,  and  In  Beckmann, 
McGuire,  and  Wlnsten,  [l]  . 

13.  On  a  Simplified  Transportation  Network 


Suppose  that  we  have  an  Idealised  network  which  can  be 
represented  achemat lea lly  by  diagrams  of  the  following  type 


Tne  vertices  represent  terminals  and  the  connecting  area 
represent  rail  lines  between  the3e  terminals.  The  arc  connecting 
the  1—  terminal  U  the  j—  terminal  In  assigned  a  numerical 
quantity,  a  "capacity",  a,  , ,  which  we  consider  to  be  the  maximum 
number  of  cars  It  can  transmit  In  unit  lime,  and  the  1—  vertex 
la  assigned  a  number,  tj  ,  tre  maximum  rate  cl  flow  through  tne 
terminal  In  unit  time. 

An  Important  quantity  associated  with  a  network  of  this 
tyj e  Is  the  maximum  rute  of  flow  from  0  ti  T  In  unit  time,  or, 
a, ore  generally,  from  any  vertex  to  any  other  vertex.  That  the 
problem  la  mn-trivlal  Is  due  to  tne  fact  that  bottlenecks  may 
develop  at  various  Junctions  If  the  outgoing  lines  hove  smaller 
capacity  than  the  incoming  lines  or  if  the  terminals  cannot 
handle  maximum  Incoming  and  outgoing  traffic.  The  problem  Is 
that  of  determining  ?  systematic  procedure  for  ascertaining  the 
maximum  rate  of  flow  from  G  t'  T  and  the  allocation  cf  cars  whlcn 
yields  this  maximum  rate. 

i 4 .  Ti pc  logical  Approach 

A?  has  happened  so  frequently  In  the  past,  a  mathematical 
theory  whlcn  treats  grot  .ems  cf  this  genre  Is  already  ip  existence. 


It  io  the  theory  of  graphs,  an  outgrowth  uf  the  electr  ical  network 
theory  of  )tl  rehuff.  The  particular  results  required  are  due  to 
Menger  [B] ,  wltn  the  application  to  railway  networks  suggesteJ  by 
A.  Hoffman,  and  worked  out  In  detail  by  Boldyreff,  h  *bacKer  »r.<i 
others .  • 

§5*  Linear  Programming 

Since  the  problem  of  deteimlning  the  maximum  rate  of  flo*» 
may  be  formulated  aa  a  maximization  cf  a  linear  function,  namely 
the  rate  of  flow  to  T  from  the  Immediately  adjacent  terminals, 
subject  to  the  Input— output  relations  and  the  capacity  restraints, 
It  Is  clear  that  the  theory  cf  linear  Inequalities  or  linear  pro¬ 
gramming  Is  applicable.  It  has  been  shorn  by  Ford  and  Fulkerson, 

[A],  thst  the  results  derived  from  Manger’s  theory  may  be  obtained 
In  this  way  from  the  duality  theorems  of  linear  programming. 

56.  The  Flooding  Technique 

Since  tne  maximization  problem  Is  derived  from  a  dynamic 
proceas  with  certain  characteristic  features,  It  le  to  be  expected 
that  we  can  find  an  Iterative  scheme  of  solution  which  will  make 
use  of  these  features  and  therefore  be  simpler  to  use  then  any  of 

tne  standard  algorithms  of  linear  programing. 

A  particularly  Interesting  technique  which  seems  to  have 

many  wider  applications  Is  the  "flooding"  technique  recently 

developed  by  Boldyreff,  which  we  snail  describe  briefly. 

*  A  very  interesting  paper  by  W.  Prager,  "On  the  Role  of  Conges¬ 
tion  In  Transportation  Problems",  Brown  University  (1955),  has 
Just  appeared  showing  that  a  very  natural  nonlinearizatlcn  leads 
to  a  unique  solution  of  the  HI tchcock-Koopmans  problem. 
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ixe  start  ut  ircm  1  l  y  routl.ig  '  ra  !  mm  ii  mux  1  man  oaiaMty 
Along  Im  linen  emanating  1' r-  rr.  u.  «t  cut.  :if»  terminal  we  may 
or  ;nay  nul  era- writer  a  tottlfi  f  •«.  IT  **•  er.v.  >unter  nu  bottle— 
necK,  we  continue  In  this  fashion  using  tre  maximum  number  <f 
trains  Available  and  r  utlng  In  a  fixed  f ash  1  n  If  we  have  a 
on  Ice,  e.  g.  maximum  capacity  to  uppermc st  '  Ine  and  continuing 
cl  'kwlae  *n  this  fauhlon.  If  we  enccunter  a  bottleneck,  we  ure 
the  maximum  allowable  number  of  trains  and  continue  tin.  process. 

Having,  gone  through  the  whole  netw  rk  In  this  way,  we  now 
remove  the  bottlenecks  one  at  a  time  by  working  backwards  either 
from  T  r  fr;m  the  stages  closest  t.  '). 

We  see  that  the  method  possesses  the  essential  features  of 
the  "relaxation"  method  which  Is  widely  used  In  applied  mathema¬ 
tics.  Although  no  Froof  has  been  given  of  tne  convergence  of 
this  technique  aa  yet,  there  seems  to  be  little  doubt  that  It  Is 
valid.  A  complete  discussion  of  the  technique  together  with 

f-  — . 

examples  will  be  found  In  a  forthcoming  paper  by  BcldyrelT,  L^J  • 

It  la  woitnwnlle  rating  that  there  1c  a  strong  analogy 
between  a  railway  network  and  a  production  network  and  thus  that 
thla  technique  may  be  equally  useful  In  estimating  tne  p  ten— 
tj all  ties  f  Industrial  networks.  • 

*  h.  Fulkereon  has  shown  that  some  structural  theorems  for 
partially  ordered  sets,  due  to  H.  P .  Dllworth,  Ann.  f 
Matn  (I9t>0),  may  be  derived  from  Menger's  theorems. 

A.  Hoffman  and  G.  Dantzig  have  given  another  prrof  based 
upon  the  duality  theorem  of  the  theory  of  linear  inequalities. 
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Tnere  are  a  number  of  Interesting  and  lm;  riant  mathematical 
problems  concerned  Kith  the  transmission  <f  power  from  ne  source 
to  another,  and  with  the  Interconnection  of  tranaml sol c n  systems. 
Let  uo  refer  tne  Interested  reader  to 

G.  Kron,  Tens  rial  Analysis  of  Integrated  Transmission  Systems, 

I,  II,  III,  IV,  Vo  1 .  70,  71,  A IKK  Proceedings. 

A.  F.  Gllmm,  P.  Haberman,  L.  K.  Kir-hmeyer ,  R.  W.  Thomas, 

Automatic  Digital  Conj uter  Applied  to  Generation  Schedul- 
ilng,  Paper  t'4— 276,  AIEE  Meeting,  June  <?1-J%,  19^4- 

- - - ,  Loss  Formulas 

Made  Easy,  Paper  E>-D09,  AIEH  Meeting,  June  10-19,  195J- 
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Part  III. 

Smoothing  Problems 


§1 .  Preliminaries 

In  thin  part  of  the  paper  we  shall  discuss  a  ^laas  of  problems 
which  are  occasionally  cabled  smoothing'  problems.  The  general 
problem  has  the  following  character:  we  wish  to  maintain  a  system 
In  a  given  state,  with  penalties  for  deviations  from  this  sta;e. 

In  sor.e  cases,  the  penalty  is  the  same  regardless  of  the  direction 
of  deviation;  In  other  cases,  we  have  one  type  of  penalty  for 
overshooting  the  requirements,  and  another  type  of  penalty  for 
not  being  able  to  meet  the  requirement  a . 

We  shall  discuss  none  simple  problems  of  thl3  type,  arising 
from  economic  and  Industrial  situations,  and  then  discuss  some 
control'  problems  arising  In  engineering  practice. 

$<?.  An  Industrial  Smoothing  Problem 

let  us  suppose  that  at  any  time  t  we  have  a  have  a  staff  of 
employees  capable  of  turning  out  a  certain  quantity  of  work  x(t), 
and  committments  requiring  a  quantity  r(t).  In  general,  the 
function  r(t)  will  be  oscillatory  as  a  function  of  time. 


r  ' r)  1 
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We  shall  assume  that  at  all  times  we  are  required  to  have 
x(t)  2  r(t)#  which  is  to  aay  we  are  required  to  meet  our  committ¬ 
ments  come  what  may. 

If  x(t)  exceeds  r(t),  we  consider  ourselves  to  be  losing  an 
amount  of  money  In  excess  wages  proportional  to  (x( t)-r(t) )dt  c  'er 
the  Interval  (t,t+dt).  However,  If  we  decrease  x(t)  to  the  level 
of  r(t),  we  are  faced  with  the  prospect  of  having  possibly  to  In¬ 
crease  x(t)  If  r(t)  Increases.  This  cannot  be  done  without  cost, 
and  we  shall  take  the  cost  of  doing  this  proportional  to  dx/dt. 
Assuming  that  it  costa  ua  nothing  to  decrease  x(t),  the  coat  of 
changing  the  level  of  labor  supply  over  th#»  Interval  (t,t-Kit)  will 
be  taken  to  be  proportional  to 

(l)  max  (dx/dt,  0)dt 

The  total  coat  over  an  Interval  [0,Tj  can  then  be  taken  to 


be 

(2)  J(x)  -  (x(  t)-r(t) )  ♦  a  M**  (dx/dt,  0)  Jdt 

where  a  la  some  poaitlve  constant. 

The  problem  la  now  to  chooae  an  abaolutely  contlnuoua  x(t) 
which  minimize*  J(x)  while  satisfying  the  requirement  x(t)  2  r(t). 

The  solution  turns  out  to  have  a  quite  simple  form,  see 

§ 3 •  Dlacrete  Veralon 

If  we  now  take  time  to  be  measured  In  dlacrete  unite,  the 
analogue  of  the  expres  Ion  In  (2.2)  la 

N 

(1)  J*fx\  -  £  [  x(k)-r(k)  +  a  Max  (x(k+l  )-x(k) ,  0)3 

J  k-1 

The  conatralnt  la  now 

(2)  x(k)  2  r(k)  • 

The  solution  to  thla  problem  la  similar  to  that  riven  for  the 
contlnuoua  version,  see  Karlin  [8] . 

§4.  Expansion  Limitation 

An  Interesting  veralon  of  the  above  problem  la  one  In  which 
we  do  not  allow  arbitrarily  rapid  increase  In  x(k)  or  x(t).  Thus 
for  the  discrete  case  we  may  Impose  a  condition  of  the  type 


I’¬ 


ll)  x(k+l)  ^  Ax(k)  , 

or 

(2)  x(k*l)  -  x(k)  ^  b  . 

A  problam  of  the  first  kind  has  boon  treated  by  Baldwin  and  Shepnard, 

In  an  unpublished  work. 

J5 •  Tht  Caterer  Problem 

I/et  us  now  state  another  smoothing  problem  In  the  foim  ,;!vcn 
by  W.  Jacobs. 

'A  caterer  know3  that  in  connection  with  the  meals  he  has 
arranged  to  serve  during  the  next  r.  days,  he  will  require  r^  2  0 

^  Va 

fresh  napkins  on  the  J —  day,  J  -  1,  2,  . . . ,  n.  Laundering  nor¬ 
mally  takes  p  days;  that  is  a  soiled  napkin  sent  for  laundering 
Immediately  after  use  on  the  J—  day  is  returned  In  time  to  be 
used  again  on  the  (j*p)~  day.  However,  the  laundry  also  has  a 
higher  coat  service  which  returns  the  napkins  in  q  \  p  days  (p 
and  q  Integers).  Having  no  usable  napkins  on  hand  or  In  the 
laundry,  the  caterer  will  meet  his  early  needs  by  purchasing 
napkins  at  a  cents  each.  Laundering  costs  b  and  c  cents  a  napkin 
for  the  normal  and  high  cost  service  respectively.  How  does  the 
caterer  arrange  matters  so  aB  to  meet  his  needs  end  minimize  his 
total  outlay  for  the  n  days? 

The  solution  for  the  case  where  q  -  p— 1  is  given  by  Jacobs 
in  [7]. 
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16.  The  Optimal  Invntory  Problem 

The  preceding  problems  have  been  of  determlnletlc  type.  Lot 
us  now  consider  a  stochastic  version. 

The  situation  Is  as  follows.  At  various  specified  times,  we 
have  an  opportunity  to  order  supplies  of  a  certain  set  of  items, 
where  the  coat  of  ordering  depends  upon  the  number  ordered  of  each 
Item,  and  where  there  may  or  may  rot  be  some  fixed  administrative 
costs  which  are  Independent  oi*  the  number  ordered.  At  various 
other  times,  demands  are  made  upon  the  stocks  of  these  Items.  'Rie 
interesting  case  is  where  the  demands  are  not  known  In  advance, 
but  where  we  do  know  the  Joint  distribution  of  demands.  The  In¬ 
centive  for  ordering  Ilea  In  a  penalty  which  Is  assessed  whenever 
the  demand  of  an  Item  exceeds  the  supply.  Different  penalties  are 
levied  in  different  fields  of  activity. 

We  wish  to  determine  the  ordering  policy  which  minimizes  the 
expected  coat  of  the  total  process. 

Here  Is  a  case  where  we  have  one  type  of  penalty  for  being 
unable  to  supply  the  demand  and  different  penalty  for  being  over¬ 
stocked.  This  last  penalty  may  be  expressed  in  terms  of  frozen 
assets,  In  storage  cost,  etc. 

The  problem  was  first  formulated  by  Arrow,  Harris  and 
Marschak  [l],  and  has  been  subsequently  treated  >y  Dvoretzky, 
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Klefer  and  Wulfowltz,  |6j  ,  Bellman,  L?j,  and  Bellman,  (illcksberg 
and  OroBb,  [hj  . 

$7 .  Learning  Processes 

In  formulating  the  problem  above,  we  have  assumed  that  we 
kne./  the  distribution  of  demand.  In  many  cases  this  lo  not  true, 
and  we  hav*-  the  additional  problem  of  determining  the  probability 
distribution  and  making  decisions  at  the  same  time.  A  process  of 
this  type  we  call  a  "learning  process  ,  cf.  our  discussion  in  the 
Introduction. 


Problems 

of  th  1 

s  type  arl 

nos*  fr 

eq  ic 

utly  Lu  ctat Let  ic 

lnveotlqat Ion 

'fie  re 

they  have 

'Ivor.  rise 

t  0 

the  theory  of  oe- 

quential  analysis  of  Wald. 

An  Interesting  survey  of  this  ’cnernl  area  is  contained  in 
the  paper  of  RobVna,  . 

$8 .  Control  Processes 

Let  us  close  this  part  with  a  brief  description  of  the  types 
of  Mathematical  problems  arising  in  the  thoory  of  control  processes. 
Let  ua  consider  a  physical,  economic,  or  engineering  system,  v/hose 
state  at  any  hlnin  is  determined  by  the  vector  x(t).  If  left  to 
itself,  the  system  will  be  determined  by  the  linear-  differential 
equation 

(l)  dx/d*  -  Ax  ,  x(0)  «*  c  , 

where  A  is  a  constant  matrix  and  o  is  some  initial  value. 
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Let  us  suppose,  however,  that  we  want  the  oystem  to  behave 
In  a  different  way,  one  specified  by  the  vector  y(t).  To  force 
the  system  Into  this  desired  state,  we  must  Introduce  some  ex¬ 
ternal  Influence,  which  we  call  "control". 

For  our  purposes  we  assume  that  this  external  Influence 
manifesto  Itself  by  way  of  an  Inhomogeneous  term,  a  "forcing" 
term,  sl  that  (1J  above  becomes 

( 2  )  d  x/d  t  =  Ax  *  f  ( t )  ,  x  ( 0 )  -  c 

As  usual.  It.  costs  us  something  to  exert  this  centre  1 .  In 
determining  .he  amount  of  control  we  will  exert,  we  must  balance 
the  cob1  o'-  control  against  the  coat  of  deviation  of  the  system 
from  Its  leaixed  state.  Depending  upon  the  way  we  measure  these 
var*  ...  ousts,  we  obtain  various  classes  of  mathematical  problems.* 

Problems  of  precisely  similar  mathematical  type  arise  In 
mathematical  economics  In  connection  with  reinvestment  policy. 

Here  It  Is  a  question  of  determining  the  rate  at  which  profits 
should  be  put  back  Into  a  business  so  as  to  maximlr*  the  total 
profit  we  obtain  over  a  given  period. 

For  other  aspects  of  control  processes  we  refer  to  tne  bock 
by  N  .  Wiener ,  (j.o]  . 

•  See,  R.  Bellman,  I.  Gilcksberg  and  G.  Gross,  "Some  Variational 
Problems  In  the  Theory  of  Dynamic  Programing" ,  Rend  oonte  del 
lalemc,  (to  appear),  Proc.  Nat.  Acad.  Scl.,  Vol  .  39  ^  1 953 )  • 
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Part  IV 

Computational  Processes 


$  1 .  Preliminaries 

In  discussing  scheduling  processes  associated  with  the  use 
of  computing  machines  we  are  entering  a  field  of  great  Importance 
where  little  has  been  done  In  comparison  to  the  large  ni  nber  of 
important  and  difficult  problems  remaining. 

We  shall  make  no  effort  to  cover  the  vast  area  of  problems 
encountered  In  determining  efficient  coding  procedures,  but  rather 
mention  briefly  some  problems  of  particular  interest  from  tne 
standpoint  of  scheduling  theor.  First,  we  shall  consider  a 
problem  concerned  with  the  evaluation  of  polynomials  posed  by 
Ostrowekl.  This  Is  a  particular  case  of  the  general  problem  of 
determining  uniform  procedures  for  computing  square  roots,  solving 
polynomial  equations,  and  so  on. 

Then  we  shall  dlacuss  the  sorting  problem.  Here  we  are 
given  a  aet  of  items  in  some  Jumbled  array  and  we  wish  to  arrange 
them  In  some  assigned  order,  say  alphabetically,  or  chronologically, 
oi  with  respect  to  other  properties.  A  particular  case  of  this  is 
tne  problem  of  determining  the  maximum  of  n  quantities,  which  arises 
m  computing  the  solutions  of  the  functional  equations  occurring  in 
the  theory  of  dynamic  programming. 


P-651 


-4 - 

§2 .  Homer 1  o  Rule 

If  we  wish  to  calculate  the  value  of  the  polynomial 

(1)  <('•)  -  V"  '  '  •••  '  an-lx  '  an 

for  a  particular  value  of  x,  we  can  do  It  In  the  following  un¬ 
inspired  fashion.  We  first  calculate  the  powers  of  x,  namely 
x? ,  x^,  .  ..,  xn,  requiring  n— 1  multiplications,  and  then  compute 
the  products,  Eqx",  a^x^^,  ...»  a^^x,  n  additional  multiplica¬ 
tions.  Having  performed  these  2iv-l  multiplications,  we  now  re¬ 
quire  n  additions  to  complete  the  evaluation.  ,T%hus  we  require  a 
total  of  2rv-l  multiplications  and  n  addl tlons,  fol lowing  this 
procedure . 


Them  are  many  shorter  methods.  One  method,  which  le  usually 
called  Horner's  rule,  or  synthetic  division,  employs  the  sequence 
of  polynomials 

(2)  f,x( x)  -  aQx'-  f  a^x  . . .  + 

connected  by  the  recurrence  .elation 

(3)  "  *  ^^_i(x)  f  ^ 

It  is  eaay  to  see  that  f  (x)  computed  according  to  this  algorithm 
requires  only  n  multiplications  and  n  additions. 


It  aeems  intuitively  clear  that  no  method  can  Improve  upon 
this,  but  the  proof  seems  difficult.  See  Ostrowski,  [2]. 


J- Ujl 
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13.  Unlvertal  Algorithms 

The  problem  we  have  posed  above  is  a  simple  example  of  a  claso 
of  problem*  that  we  meet  In  coding  for  high  speed  computing  machines. 

Various  criteria  are  employed  to  measure  the  efficiency  of  a 
coding  procedure.  We  may  wish  to  minimize  the  possibility  of  error, 
minimize  the  oomputlng  time,  minimize  the  memory  requirements,  and 
so  on. 

There  la  a  vast  literature  on  these  topics  in  connection  with 
solving  systems  of  llnesr  equations,  systems  of  differential  equa¬ 
tions,  partial  differential  equations  and  so  on. 

$4.  Determining  the  Maximum  of  n  Quantities 

An  interesting  function  of  n  quantities  is  the  r.nxl:n.n 
quantity.  The  use  of  computing  machines  in  determining  the 
maximum  pf  a  given  number  of  quantities  is  extremely  important 
In  connection  with  functional  equations  of  the  type 

(l)  f(x)  »  max  [  g(y)  +  h(x~y)  +  f(ay  b(x-y))  ] 

0^y<x 

which  arise  in  the  theory  of  dynamic  programming,  see  ft]  . 

§5.  Sorting 

Determining  the  maximum  or  minimum  of  n  quantities  is  a 
special  case  of  the  problem  of  sorting  n  quantities  according  to 
•one  preassigned  ordering  relation. 


r,-T)51 

~H>U 


There  are  really  many  special  claBBea  of  problemo  of  thla 
type.  For  example,  one  problem  is  that  of  determining  a  uniform 
procedure  which  will  work  for  any  given  set  of  quantltlee.  Another 
problem  la  that  of  determining  a  sorting  procedure  which  will 
minimise  expected  sorting  time  when  we  are  given  the  items  one 
at  a  time  or  In  small  batches  and  the  information  that  there  la 
a  given  distribution  governing  their  ordering.  A  further  problem 
is  *hat  of  simultaneously  ordering  and  determining  the  distribution 
as  we  ro  along,  which  Is  to  say  a  learning  process. 

A  discussion  of  related  problems  is  contained  in  Seward,  [jj  , 
where  a  number  of  further  references  may  be  found. 


Y—  J  '  1 
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Part  V 

Applications  of  the  Theory  of  Linear  \  regranm.l ng 


^ 1 .  Introduction . 

In  the  previous  chaj  ters,  we  have  dlacuaaed  a  number  of 
different  classes  of  scheduling  processes  together  with  varl  us 
analytic  and  computational  techniques  which  ’nay  be  utilized 
to  treat  there  problems  tr  a  greater  or  leaser  degree.  In  this 
chapter  our  theme  is  the  theory  of  linear  pr  grammlng .  We  sh.ll 
Illustrate  by  means  of  a  number  of  examples  chosen  from  different 
fields  how  wide  Is  the  range  cf  application  of  this  Important 
mathematical  tool. 

The  theory  of  linear  {rcgrammlng  has  as  Its  central  purpose  i 

the  problem  of  obtaining  tne  maximum  or  minimum  cf  tf.e  linear  form 

n 

(1)  L(x )  ■  L  cixi 

1-1  11 

subject  to  trie  series  of  constraints 

(?)  n 

v  L  a  x  >  fc.  ,  1-1 ,?,... ,m. 

«  m  1  *  *»'  %J  *■ 

* 

The  theory  of  nonlinear  programming  Is  concerned  with  the 
cor  espcndlng  ;r  Lien  f>r  nonlinear  functions.  However,  this 
study  has  net  achieved  the  same  stage  of  advancement  ns  the 
linear  theory,  for  obvious  reaB  ns,  and  hence  ww  shall  n>  t 
dlacuss  It  here.  The  lntereated  reader  may  consult  Kuhn  and 
Tucker,  |  13  |  , 

The  classical  theory  of  Inequalities,  es  devwl  ;  ed  thirty 
to  fifty  years  ago  by  Dines,  Parkas,  Motzkl^,  !Stl«nke,  and  there, 
furnishes  a  number  of  elegant  theoretical  results,  together  wltl 


p-/>  1 
-SO— 

computational  methods.  The  essential  aim  of  the  newer  theory  of 
linear  programming  la  to  discover  and  apply  rapid  conputat 1 < na 1 
algorithms  which  will  yield  t tie  numerical  aclutlcn  of  problems 
of  tne  above  type  of  large  dimension  either  by  hand  or  machine 
computation . 

The  most  useful  and  flexible,  In  the  sense  of  being  wldelj 
applicable,  algorltlim  devised  to  date  la  tie  "simplex”  method  of 
D.  Dantzlg,  together  with  Its  modifications  and  extensions  ty 
Peale,  Chnrnes,  and  Cooper,  Dorfman,  Lemke ,  and  Dant/.lg  himself. 

To  Illustrate  trie  range  of  application  of  these  techniques, 
we  3hall  consider  a  number  cl  problems  In  some  small  detail. 

These  Involve  the  routing  of  aircraft,  the  determination  of  the 
number  and  arrangement  f  toll  collectors  at  t ridges,  the  scheduling 
f  military  tanker  fleets,  network  problems,  production  smoothing 
problems,  tne  "fixed  charge"  problem,  and  finally  some  examples 
Involving  uncertainty.  These  last  two,  however,  can  only  be 
treated  In  very  special  cases,  and  at  the  moment  are  a  challenge 
to  the  Ingenuity  of  the  mathematician, 
q ?.  Pr jductlon  Smoothing . 

We  have  discussed  a  few  smoothing  problems  above.  Let  us 
now  consider  one  that  may  be  formulated  is  a  linear  programming 
prcblem.  A  single  Item  Is  to  be  produced  over  a  given  number  of 
time  periods  to  satisfy  certain  requirements  at  each  of  theso 
periods.  We  wish  to  produce  this  Item  so  as  to  minimize  the  total 
cost  which  Is  composed  of  costs  of  production,  costs  of  storage, 
and  coats  for  cnange  In  production  rate. 

To  fofwruiate  trie  problem  mathematically,  let  T  be  the  total 


number  of  time  periods  And  define 


Y-f  M 

01- 


(1) 


requirement  at  time  t,  assi med  known, 
quantltv  produced  over  the  timv.  period 
x^^-x^  £  0,  the  Increase  In  production  rate  at 
time  t. 


Let 

(?)  -Xx^  "  the  total  production  from  t  -  0  to  t  -  1 

-Ir^.  "  the  total  requirement  over  the  period  t  -  u 
to  t  ■  1,  with  R  -  0.  Then  the  excess  of  accumulated  pr<  1uctl»n 
over  accumulated  requirements  up  to  time  1  Is  given  by 

(3)  vaA  -  uo  ♦  Xj  -  Rt  >  °, 

where  u^  Is  a  given  constant,  the  excess  productlrn  at  the  start 
of  the  process. 

To  express  the  costs,  let 

(4)  c^  -  the  cost  of  producing  each  unit  In  the  oerlod  l-l  to  1, 

dj  •  trie  cost  of  atorlrg  each  unit  of  excess  u^  for  ne  period, 
e^  -  the  cost  of  Increasing  production  rste  one  unit 
per  unit  time  at  time  1 . 

The  problem  Is  then  to  minimize  the  total  ccst  of  tne  process, 


T 

(5)  £  (c.x  +d  u  *e  y, ) 

1-0 


subject  to  the  constraints 

1  1 
I 

t-1 


(6) 


(a) 


x.  >  Z 

Z  ~  t-1 


(b)  x1  ,y1 ,Uj  >  0. 

In  their  paper,  J  r  ]  ,  of  Part  III,  Dantzlg  and  .Johnson  exhibit 
a  rapid  graphical  method,  Involving  only  Intersections  and 
rotatlona  of  straight  lines,  which  seema  to  require  only  a  few 
Iterations.  See  also  A.  J.  Hoffman  and  W.  Jacobs ,[  12 


i 


c< 3  •  Tra 1  *li£  —-IJll-  Hi  To 21  Boothe  . 

An  Interesting  problem  In  the  general  theory  of  queuing  le 

r  f 

treated  by  L.  C.  Edle  In  1  K  l.  It  concerns  the  collection  of  tolls 

I  J 

at  Port.  Authority  tunnels  end  bridges  in  New  York  City.  The 
Pert  Authority  desires  to  handle  traffic  with  the  minimum  number 
of  toll  collectors  that  Is  conaletent  wit!  both  adequate  eervlce 
to  the  public  and  a  sufficient  number  of  relief  periods  for  the 
toll  collector.  These  relief  periods  are  required  since  tne 
work  Is  continuous  and  exacting.  We  then  have  the  uaual  conflict 
between  economy  and  service. 

Having  determined  the  traffic  characteristics  by  observation 

over  h  period  of  time,  Edle  reduced  the  problem  to  one  cf 

scheduling.  The  solution  obtained  theoretically  wan  found  In 

actual  practice  to  be  very  ea 1 1  afactory . 

At  toe  suggestion  of  E.  W.  Paxaon,  the  problem  nsb  tackled 

by  G.  Lantzlg,  5j.  His  formula tl c n  of  the  problem  leads  to  the 

problem  of  determining  the  minimum  of  L(x)  subject  to  the 

restrictions 

:n 

(1)  I  a,  ,x  >  b(,  1-1,?,...,  m+14 

1-1  1 

x1  >  0, 

where  the  eGeentlal  feature  of  tre  problem  Is  that  the  are 
either  C  or  1.  As  a  c^neequerce  of  this,  pret  lrr.s  cf  moderate 
size  can  often  be  solved  by  hand  computation  In  a  few  hours, 
ualrlg  trie  dual  simplex  technique.  The  observation  that  the 
problem  Is  a  variant  cf  a  transportation-type  problem,  see  6  j, 
enables  large  systems  *o  be  sclved  rapidly  with  the  aid  of 


computing  machines. 

^4 .  Scheduling  a  HI  1 1 tary  Tanker  Fleet . 


In  a  previous  chapter  we  mentioned  tho  HI tchcock-Koopmans 
transportation  problem,  and  noted  the  fact,  that  Independent  formu¬ 
lations  and  computational  schemes  had  been  given  by  a  number  of 
different  people.  A  degenerate  form  of  the  transpertat!  >n  problem 
Is  the  assignment  problem,  which  han  been  treated  by  the  simplex 
method  In  a  paper  by  Votaw  and  Ord*»n,  see  fej. 

An  lntereetlng  application  of  the  Koopmans— Dantz 1 g  approach 
to  the  general  transportation  problem,  using  the  simplex  metr.od 
of  computation,  Is  contained  In  a  paper  by  M.  M.  Flood,  11 
discussing  the  scheduling  of  a  'nllltary  tanker  fleet. 

Another  discussion  of  the  problem  is  contained  In  a  paper 
by  0.  H.  Dantzlg  and  D.  R.  Fulker8^n,|  9  ,  where  they  show  that 

fairly  large  problems  of  this  nature  can  be  solve!  by  hand  compu¬ 
tation  requiring  only  a  lew  Iterations.  An  alternate  computational 
scheme  had  previously  been  given  by  Robinson  an  1  ft’alBh.jlf 

a  similar  pr<  blem  occurs  In  connection  with  the  routing 
aircraft  where  there  are  a  number  of  alternative  routes,  i  nu.r., 
of  different  types  of  aircraft,  and  different  payloads  and  traffi. 
cn  different  routes.  For  a  discussion  of  this  problem  see,Jt 

I 

^5-  Plxed  Charge  Problems . 


In  the  previous  sections  we  have  discussed  a  number  of  problems 
which  can  be  resolved  readily  using  the  computational  methods  of 
linear  programming .  Let  us  now  present  some  problems  which,  are 
either  Intractable  or  can  only  be  handled  in  sfeclnl  rases. 


Consider  th#  follow. ng  situation.  We  have  a  factory  containing 


•>  different  machines  each  capable  of  performing  any  of  n  dletlnct 
operations.  Let  hjj  denote  the  time  consumed  by  the  J~  machine 

k  L. 

performing  the  1—  operation  on  a  unit  quantity  of  goods.  Let 

t/  h 

denote  the  quantity  of  goods  on  which  the  1—  operation  Is 
performed  by  the  J—  mathlne,  and  b^  the  total  quantity  of  goods 
which  require  the  1—  operation.  The  following  relatlcne  are 
satl sf led 

n 

(l)  ^  £  x.  .  -  b.  ,  1  -1 ,m, 

J-l  J  1 

b.  x.  ,  >  0. 

1  j  “ 


Let  ue  assume  furthermore  that  there  Is  a 


total  man  hours  available  for  the  J 

(?) 


th 


machine ; 


m 

£ 

1-1 


hu  xu  ^  V  . "• 


constraint  on  the 
1  .e . 


The  most  efficient  operation  Is  taken  to  be  the  choice  of  the 
which  minimizes  the  tctal  coat  of  operation, 

m  n 


(3)  L(x)  -  X  Z  r.,x 

1-1  J-l  lJ  1J 


In  this  formulation^ the  problem  falls  within  the  domain  of 
linear  programming. 

Let  ue ,  however,  now  assume  that  there  Is  a  fixed  charge,  k 
for  preparing  th#  J—  machine  for  the  1—  operation,  regardless 
of  the  length  of  time  that  the  machine  Is  used.  The  total  cost 
la  now 


(M 


L(x)  -  £ 

1-1 


^c!JxlJ+klJ 


) 


1 

J 


1J' 


whet# t  (x)  Is  the  discontinuous  function  defined  by  the  conditions 


<*  ( x )  -  1 ,  x  >  0 
«  0 ,  x  **  0 
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(5) 


/ 


I 

\ 
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The  problem  of  minimizing  the  total  coat,  aa  given  by  (4) 
la  one  that  at  the  moment  eacapee  any  of  the  known  efficient 
computational  algorithms.  It  la  interesting  to  note,  however, 
that  the  apeclal  case  where  kj  ^  •  k  may  be  treated  by  an  extension 
of  the  conventlcnal  techniques,  aee  D^ntzlg  and  Hlrach,  • 

A  almllar  difficulty  arlaea  In  the  "optimal  Inventory"  problem 
where  the  k^  ^  correapond  to  paperwork  or  "red  tape"  coata  In  aome 
oaaea  and  to  physical  uet-up  coats  In  others,  see 
§6  ,  Convex  Functions  and  Uncertainty . 


$ 


Moat  problems  Invoking  uncertainty  or  stochastic  processes 
lie  outside  the  range  of  linear  programming  techniques.  In  aome 
caaea  they  can  be  treated  by  the  methods  of  dynamic  programming, 
aee[  1  ],  where  further  references  may  be  found,  nnd  In  most  caaea 
they  remain  unsolved. 

There  are,  however,  a  class  of  problems  involving  uncertain 
demand  which  lead  to  the  problem  of  minimizing  a  Bum  of  the  form 

(1)  M(x)  «  Z 

1-1  1  1 

subject  to  linear  conatralnta,  where  the  are  convex  functions 

of  the  x^,  or  alternatively,  of  maximizing  the  sum  when  the 
f>^(x)  are  concave  functions.  Theee  can  be  treated  by  linear 
programming  techniques  if  we  approximate  to  ^  (x)  by  a  step 
function.  Details  may  be  found  In  ^4  ]x*  ^  7  '. 

Let  ua  consider  a  simple  example  involving  uncertain  demand, 


•The  Pixed  Charge  Problem,  RR-15&3,  HAND  Corporation,  1954. 


i 
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occurring  In  the  walriut-grovi  ,g  Industry,  which  leads  to  a  problem 
of  the  above  type.  Each  year,  the  walnut  crop  conalota  of  wainuta 
of  different  grades,  say  0|,0#,...,0k  In  quantities  q i ,q»,  .  .  .  ,qk • 
Using  various  quantities  of  each  grade  assortments  of  wahuts  are 
out  together  for  commercial  sale.  Let  us  assume  that  there  are 
N  different  types  of  packets  selling  for  prices  p i ,p», . . • ,p^ 
per  packet  respectively.  If  we  assume  that  there  are  fixed  demands 
for  these  assortments,  for  the  1—  assortment,  then  the  problem 
may  be  formulated  vary  easily  aa  a  generalized  traneportat Ion  problem. 
Let 

(2)  Xjj  -  the  amount  of  the  1—  grade  of  walnuts  that  le 

used  to  make  up  the  J—  assortment. 

Then  we  have 


(?) 


2  i  i  ^ 

J«1  J  0 


th  , 


The  number  of  packets  cf  the  1 —  kind  that  car  be  put  t<  gether  la 


(4)  Uj  -  Min  xtJ 

where  Uj  aatlaflea  the  reatrlctlon 

(5)  u,  <dj. 

The  *otal  profit  la 

N 

(6)  P  *  Z  u  ,P,  • 

J-l  J  J 

The  problem  of  maxlrlzlng  the  profit  can  be  resolved  numeri¬ 
cally  using  the  etandard  techniques. 

Consider,  however,  the  case  where  the  demand  la  uncertain. 

In  this  case  we  mayaaoume  that,  on  the  basis  of  experience,  we 


can  predict  the  distribution  of  demand  for  each  t^>«  of  assortment.* 
Let  dO^  (z  )  be  the  dl  ntrl but  ion  function  for  the  demand  for 
the  1—  packet.  If  packeto  are  made, the  expected  profit 
will  be 

.  1  fo 

(?)  Pj_  {//  idG1(z)  ♦  Uj  t/f  f!01  (z ) 

Hence  the  total  expected  profit  la 
N 

(&)  £  p.  ^.(uj 

1-1  1  1  * 

where 

u  c u 

(9)  ^j(u)  m(/J0  zdQi(  7  )  ♦  u  i/J,  dQ(z) 

u 

-  u  ♦  //?  (z-u)dG(z) 

w  c 

It  la  easy  to  see  that  each  {^(u)  la  a  concave  function.  Hence 
the  approximation  method  used  above  may  be  employed. 

A  problem  of  similar  type,  arising  from  the  problem  of 
allocation  cf  a  carrier  fleet  to  airline  routes  to  meet  an  uncertain 
demand  la  treated  by  0.  Dantzlg  1 n  j  ?  J. 

Let  ua  mention  In  paealng  that  maximization  of  expected 
profit  may  be  undesirable  If  there  la  a  considerable  risk  Involved. 
We  may  prefer  a  smaller  expected  profit  and  a  smaller  risk,  or 
a  smaller  variance.  An  interesting  discussion  of  this  geneial 
problem  la  contained  In  Markcwl tz ,;  14'. 


•This  must  be  taken  cum  grano  aall3. 


Part  VI  . 


Crystal  Qazlng 


§1.  Introduction 

In  the  previous  parts,  we  have  examined  a  number  of  problems 
of  various  types  and  discussed  a  number  of  mathematical  techniques 
that  have  been  employed  to  handle  these  problems.  In  this  part  we 
shall  turn  the  spotlight  on  a  number  of  regions  of  mathematics 
which  we  feel  must  be  Intensively  explored  before  we  can  hope 
master  the  field  of  scheduling  theory. 

Taking  subjects  in  no  particular  order  as  far  a3  priority 
or  Importance  or  difficulty  are  concerned,  we  shall  discuss  the 
extremum  properties  of  functions  defined  over  discontinuous 
groups,  non-classical  aspects  of  the  calculus  of  variations, 
non-commuta^lve  stochastic  processes,  non-markovlan  processes, 
and  iterative  techniques. 

Each  of  these  topics  is  well  worth  studying  In  its  own  right 
apart  from  any  possible  applications.  However,  It  Is  probably  as 
true  here  as  in  other  parts  of  mathematics  that  the  best  entry  to 
a  new  field  is  by  way  of  an  Important  and  natural  physical  problem. 
Scheduling  theory  contains  an  abundance  of  these,  almost  all  diffi¬ 
cult  and  challenging. 


§2.  Lx  t  rr  rnigi  Pih  >crtlen  of  Pune  t 1  one  on  Dlscontlnuoua  Pro  up  a 

The  cluonlcal  problems  in  variational  analyoio  may  be  handled 
uniformly  by  the  principle  of  continuoua  variation  of  the  indepen¬ 
dent  variables  In  the  neighborhood  of  the  extremum.  In  many  of  the 
problemc  wo  have  diocuased  above,  as  for  example  the  aaeembly  line 
problems  of  Part  I,  we  are  confronted  by  the  problem  of  maximizing 
over  the  set  of  all  permutations  on  n  objeote.  Here  the  oeneept 
of  continuous  variation  is  aliasing,  and  this  accounts  for  a  great 
deal  of  the  difficulty  of  the  problem. 

It  would  Been  therefore  that  a  study  of  the  extremum  properties 
of  functions  defined  over  discontinuous  groups  Would  have  inter¬ 
esting  and  Important  consequences  for  scheduling  theory,  and  that, 
conversely,  a  good  point  to  begin  this  study  would  be  in  connection 
with  the  permutation  group  on  n  objects,  the  fundamental  group  of 
scheduling  theory. 

S3*  Non— classical  Calculus  of  Variations 

As  we  have  seen  In  Part  I,  the  continuoua  versions  of  some 
problems  involving  permutations  lead  to  variational  problems  over 
the  3pace  of  characteristic  functions. 

Problems  of  this  type  are  not  amenable  to  the  classical 
variational  techniques  and  require  new  techniques.  A  particular 
problem  which  has  not  been  previously  treated,  and  which  arisen 
in  the  study  of  production  processes  involving  mutually  exclusive 
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optruuions,  la  that  of  determining  the  extrema  of 

a)  j(*)  -  y'J  m  f  »  4  2  *  *  *  *  ^  »  t  )  ti  t 

where  the  ^(fc)  are  subject  to  the  constraints 
(2)  a.  0  <;  ^(t)  <;  1  , 

b.  *i(t,dt  *  '■'i  .  kl  “  T 

o.  *t(t)4j(t)  -  0  for  t  +  J 

Problems  of  this  type  arise  also  In  the  theory  of  multi-stage 
production  processes  Involving  mutually  exclualve  activities,  [?]  . 


54.  Non-coramutatlve  Stochastic  Processes 

The  classical  theory  of  probability  is  occupied  almost  ex¬ 
clusively  with  the  study  of  commutative  processes,  in  the  following 
sense.  Let  x4  be  a  sequence  of  vectors  navlng  a  common  distribution, 
and  let 

N 

(1)  *N  -  2 

1-1  1 

The  olaaaloal  limit  theorems,  such  as  the  central  limit 
theorem,  are  oonotmed  with  the  question  of  determining  the 
asymptotic  distribution  of  various  functions  of  z^. 
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If  we  consider  zN  to  represent  the  state  of  a  physical  system 
at  time  N,  the  x^  represent  certain  random  disturbances  of  the 
system.  In  writing  as  a  sum  of  these  disturbances,  we  uro 
taoltly  assuming  that  tnese  disturbances  commute  as  far  as  their 
effects  are  concerned,  l.e.  their  order  of  occurrence  of  no  im¬ 
portance. 


In  many  situations,  this  Is  not  true.  Consider,  for  example, 
a  system  whose  state  at  any  time  Is  specified  by  the  vector  x. 

Let  an  event  correspond  to  a  transformation  of  this  Bystem  Into 
another  vector  x'  and  let  the  transformation  be  a  linear  one. 

Then  x'  -  X^x,  and  If  the  events  are  stochastic  the  matrix  X^  la 
a  stochastic  matrix.  The  result  of  n  successive  events  will  be  a 
stochastic  vector  x^  given  by  the  relation 

<2>  *n  -  Wi  •  •  •  W 

where  the  are  stochastic  matrices. 

The  problem  of  determining  the  limiting  distribution  of  the 
vector  x^  given  the  distribution  of  the  random  matrix  X^  seems  to 
be  a  very  difficult  one  which  has  been  discussed  up  to  the  present 
In  very  brief  detail,  cf  [l]  . 


The  difficulties  of  queuing  theory  are  In  a  large  part  due 


to  the  non-coramutatlve  aspects  of  the  problem  and  the  resultant 

V 

non-linear  functions  which  occur. 
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15’  Non-Harkov  3  an  Processes 

Consider  a  sequence  of  random  variables  *h®re  1  -  1,  2, 

The  three  most  Important  types  of  sequences  which  have  been  studied 
to  date  are  sequences  of  Independent  variables,  Markoff  processes, 
and  stationary  processes.  In  each  of  these  cases,  the  sequence 
possesses  a  special  structure  which  enables  us  to  bypass  any 
necessity  for  the  complete  past  history  of  the  sequenoe,  in  pre¬ 
dicting  the  behavior  of  future  elements  in  the  sequence. 

In  scheduling  theory,  however,  and  in  many  other  stoohastlc 
processes  as  well,  the  structure  is  more  complicated.  We  must 
study  various  classes  of  stochastic  sequences  w  ere  the  distribu¬ 
tion  of  x i  depends  upon  tts  distribution  of  al*  uie  preceding  Xy 
Posed  In  this  way  the  problem  Is  too  broad,  and  it  would  seem 
that  once  again  the  best  approach  to  an  extension  of  the  present 
mathematical  theory  lies  in  a  study  of  the  natural  problems 
which  arise  from  queuing  theory,  scheduling  theory,  and  related 
fields. 

§6 .  Further  Applications  of  Pane  Theory 

As  we  noted  in  #15  of  Part  I,  the  solution  to  the  assignment 

problem,  which  crudely  requires  nl  calculations,  can  be  obtained 

2 

as  the  solution  to  an  n  x2n  game,  which  is  an  enormous  decrease 
In  dimensionality  for  large  n. 
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An  Important  problem  which  immediately  springs  to  mind  la 
that  of  cataloguing  the  classes  of  problems  Involving  permutations, 
or  more  generally  variation  over  the  elements  of  a  discrete  group, 
which  can  be  trana formed  Into  two— person  games  of  lower  dimensions. 

An  Interesting  problem  which  Includes  the  scheduling  problems 
discussed  in  Part  I  Is  that  of  determining  the  minimum  over  all 
permutations  of  tf e  of  the  function 

n 

( 1 )  r(x)  -  rnaix  Z  a.  -x. 

1  J-l  J 

§7.  Iterative  Techniques 

It  \  e  intuitively  clear  that  each  problem  that  arises  will 
have  certain  characteristic  features  which  can  be  utilized  to 
speed  the  computation  of  a  solution.  This  is  one  of  ths  advan¬ 
tages  of  considering  problems  arising  from  the  physical  world. 

Of  all  the  universes  within  pencil  reach  of  the  mathematician, 

the  real  one  Is  the  most  likely  to  furnish  Important,  Interesting 

/ 

i nd  tractable  problems. 

* 

Essentially,  the  argument  goes  that  whatever  exists  cannot 
be  too  complicated,  If  viewed  properly.  This,  of  ceuree,  Is  an 
article  of  faith  and  not  to  be  Interpreted  too  literally. 

The  idea  of  exploiting  the  Intrinsic  structure  of  a  process 
is  the  guiding  concept  of  the  theory  of  dynamic  programming. 


Similarly,  In  employing  the  algorithm  of  the  "simplex  method", 

0.  Danzig  has  introduced  many  devices  to  take  account  of  dynamic 
processes.  The  "flooding  technique"  of  Boldyreff  Id  anothor 
example  of  an  iterative  technique  particularly  adapted  to  the 
problem  it  treats. 

A  certain  amount  of  compromise  must  always  be  made  in 
formulating  oompi  ting  procedures.  If  we  are  Interested  in  cod i nr 
for  modem  high  speed  machines,  v/e  want  fairly  uniform  procedures 
so  that  recoding  will  not  be  necessary  for  every  new  p  oh: or.  that 
comes  along.  On  the  other  hand  if  an  appropriate  modification, 
or  an  entirely  new  method,  can  save  an  appreciable  amount  of  time 
on  problems  of  a  special  but  important  type  then  it  is  worth 
employing . 

A  great  deal  of  work  In  this  direction  has  been  done  In 
connection  with  solving  systems  of  linear  equations  and  in  solving 
polynomial  equations.  However,  very  little  has  been  done  from  the 
purely  abstract  point  of  view  of  classifying  structural  properties 
of  processes  end  correlating  them  with  appropriate  c  xnputatlonai 
techniques . 
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